Papers with model fine-tuning
Copied to clipboard
| Challenge: | Generating questions and answers from text is a challenging task due to the expected structured output. |
| Approach: | They propose an online service for multilingual QAG along with a python package for model fine-tuning, generation, and evaluation. |
| Outcome: | The proposed model is available in eight languages and can be used online or locally via lmqg. |
Copied to clipboard
| Challenge: | Existing methods for automatic story plan generation use coarse-to-fine representations of semantic content. |
| Approach: | They propose a structured extension to bidirectional-context conditional language generation, or "infilling" they propose evocative frame annotations and a method for frame-guided generation that leverages frame semantic lexical units. |
| Outcome: | The proposed method allows for explicit manipulation of intended infill semantics with minimal loss of distinguishability from human-generated text. |
Copied to clipboard
| Challenge: | a persistent gap remains between Recall@10 and Recall @50 across datasets . |
| Approach: | They evaluate embedding model comparison, Reciprocal Rank Fusion and embedded concatenation techniques to improve retrieval quality. |
| Outcome: | The proposed methods outperform traditional cross-encoders in identifying high-relevance passages. |
Copied to clipboard
| Challenge: | a low-resource language that is the lingua franca in Timor-Leste lacks available corpora in the health domain. |
| Approach: | They propose a solution that combines neural MT with large language model-based post-editing guided by existing glossaries and translation memories. |
| Outcome: | The proposed system outperforms both standalone MT and LLM approaches across six low-resource languages on the FLORES dataset. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been used for specialized tasks but their application to machine translation has received little attention. |
| Approach: | They evaluate reasoning-based prompting strategies across multiple language pairs and domains and measure their effect on translation quality. |
| Outcome: | The proposed prompting strategies outperform traditional prompting methods across language pairs and domains and achieve improvements of up to 6.4 BLs. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) generate nonfacts and deviate from desired criteria for text generation. |
| Approach: | They propose a controlled text generation algorithm that enforces adherence toward specific rhetorical relations in an LLM sentence-completion context by a parser-driven decoding scheme. |
| Outcome: | The proposed method generates sentences that satisfy desired rhetorical relations in an LLM. |
Copied to clipboard
| Challenge: | Large language models struggle with precise length control, particularly in zero-shot settings. |
| Approach: | They propose to use length approximation, target adjustment, sample filtering and automated revisions to improve LLMs' length control capabilities. |
| Outcome: | The proposed methods improve length control in large language models while maintaining or enhancing summary quality without the need for model fine-tuning or architectural changes. |
Copied to clipboard
| Challenge: | Existing models for learning large language models are expensive and difficult to build and fine-tune. |
| Approach: | They propose a family of data augmentation models to improve model fine-tuning efficiency . they leverage powerful LLMs to expand, refine and re-write instructions and responses . |
| Outcome: | The proposed models improve the efficiency of model fine-tuning by leveraging small datasets and quality assessment techniques. |
Copied to clipboard
| Challenge: | Existing approaches to named entity recognition are domain specific and require a domain specific architecture. |
| Approach: | They propose a retrieval augmented large language model for Named Entity Recognition . the model uses word-embedding over sentence-level embedding to fine tune . |
| Outcome: | The proposed model outperforms existing models on the CrossNER dataset. |
Copied to clipboard
| Challenge: | Entity Linking (EL) relies on large labeled datasets and extensive fine-tuning . lexical ambiguity, knowledge-intensive cases and low-context mentions are some of the challenges. |
| Approach: | Entity Linking (EL) relies on large annotated datasets and extensive fine-tuning . authors propose a pipeline that integrates candidate generation, context-based scoring, adaptive routing, and selective reasoning . |
| Outcome: | ARTER outperforms ReFinED and LLM-based pipelines on standard benchmarks . it performs twice as efficiently on 5 out of 6 datasets and doubles the number of tokens compared to pipelines using LLM . |
Copied to clipboard
| Challenge: | a typical call center only responds to 8% of customers with a customer satisfaction survey . a predictive algorithm that infers CSAT on the 1-5 scale is needed to minimize this data sparsity and response bias. |
| Approach: | They propose an algorithm that infers CSAT on 1-5 scale on inbound calls to the call center . they reframe the problem into a binary class and map it back to five classes . |
| Outcome: | The proposed model is able to support keycustomer workflows with high accuracy overmillions of calls a month. |
Copied to clipboard
| Challenge: | Our system generates and refines prompts for evaluating attribute quality across tens of thousands of product category–attribute pairs. |
| Approach: | They propose a free cascade for auto-prompting Large Language Models (LLMs) that generates and refines prompts for evaluating attribute quality across tens of thousands of product category–attribute pairs. |
| Outcome: | The proposed system improves precision and recall by 8–10% over chain-of-thought prompting while reducing domain expert effort from 5.1 hours to 3 minutes per attribute. |
Copied to clipboard
| Challenge: | Human label variation (HLV) arises when multiple labels are valid for the same instance. |
| Approach: | They propose a framework for generating and validating explanations to detect errors using large language models (LLMs) EVADE framework provides broader explanation coverage and requires less human intervention . |
| Outcome: | The proposed framework provides broader explanation coverage, requires less human intervention, and delivers better downstream performance in predicting label distributions. |
Copied to clipboard
| Challenge: | augmented zero-shot learning is a prompting method that allows large language models to perform zero-shoot text style transfer to arbitrary styles, without any model fine-tuning or exemplars in the target style. |
| Approach: | They propose a prompting method that frames style transfer as a sentence rewriting task and requires only a natural language instruction. |
| Outcome: | The proposed method is based on a large language model and is shown to perform on standard style transfer tasks and arbitrary transformations. |
Copied to clipboard
| Challenge: | a recent study shows that human and Large Language Model preferences are important for model fine-tuning and evaluation. |
| Approach: | They dissect the preferences of human and 32 different Large Language Models to understand their quantitative composition. |
| Outcome: | The proposed model is compared with 32 different large language models using real-world user-model conversations. |
Copied to clipboard
| Challenge: | Statistical Machine Translation and fuzzy matching are completely different in their finality. |
| Approach: | They propose to use fuzzy matching to train neural machine translation to make use of similar translations, in a similar way a human translator employs fuzzy matches. |
| Outcome: | The proposed methods improve translation accuracy and fine-tuned model for unseen translation pairs. |
Copied to clipboard
| Challenge: | Existing approaches for adapting large language models to diverse cultural values often rely on prompt engineering. |
| Approach: | They propose a framework for enhancing LLM alignment with cultural values based on cultural learning that leverages simulated social interactions to generate role-playing scenarios. |
| Outcome: | The proposed framework improves cultural value alignment across various model architectures measured using World Value Survey data. |
Copied to clipboard
| Challenge: | Existing reference-free reasoning evaluation metrics rely on human-annotated reasoning chains as references, but require fine-tuning with human-derived chains before evaluation. |
| Approach: | They propose to use GPT-4 to automatically evaluate reasoning chain quality by leveraging the Socratic method. |
| Outcome: | Empirical results show that the proposed approach significantly improves existing reference-free reasoning evaluation metrics. |
Copied to clipboard
| Challenge: | Existing studies have shown that pre-trained language models can be backdoored such that model behavior is manipulated when trigger tokens are presented. |
| Approach: | They propose a backdoor mitigation strategy for NLP models via adversarial prompt-tuning in few-shot settings that uses two extra sets of soft tokens which approximate the trigger and counteract it respectively. |
| Outcome: | The proposed method keeps model parameters intact and only utilizes two extra sets of soft tokens which approximate the trigger and counteract it respectively. |
Copied to clipboard
| Challenge: | Existing benchmarks often lack domain coverage and provide limited insights into the working context of Chinese LLMs. |
| Approach: | They propose a multi-domain Chinese QA benchmark dedicated to localized assessment of Chinese LLMs. |
| Outcome: | The Qwen2.5 model outperforms the more advanced GPT-4o model in the Chinese market . the dataset includes over 17,000 questions across six vertical domains . |
Copied to clipboard
| Challenge: | a new algorithm to estimate fine-tuning performance for a target task is proposed . conventional subset selection methods require repeated training on subsets of auxiliary tasks . |
| Approach: | They propose an algorithm to fine-tune a language model for a target task by optimally using auxiliary tasks' information. |
| Outcome: | The proposed method can estimate fine-tuning performance on CPUs in seconds. |
Copied to clipboard
| Challenge: | Existing methods for dynamic spatial reasoning are limited to text or static visual domains . |
| Approach: | They propose a framework that augments textual reasoning chains with dynamic visual drafts . |
| Outcome: | The proposed framework outperforms existing methods in dynamic spatial reasoning tasks. |
Copied to clipboard
| Challenge: | Existing studies based on image checker, model fine-tuning and embedding blocking are impractical in real-world applications. |
| Approach: | They propose a novel reward function measuring toxicity and text alignment of generated images and train the optimizer through Proximal Policy Optimization. |
| Outcome: | The proposed model reduces the likelihood of various models in generating inappropriate images, with no significant impact on text alignment. |
Copied to clipboard
| Challenge: | Traditional machine translation metrics are insensitive to the long tail of behavioral problems. |
| Approach: | They propose a specification-based framework for behavioral testing of NMT models . they use high-precision detectors that flag errors between a source sentence and output . |
| Outcome: | The proposed framework provides a reliable view of problems that were previously invisible. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) generate incomplete, biased or misleading outputs in their initial attempts. |
| Approach: | They propose a method for refining text generation that takes into account semantic stability, entailment and inter-sample uncertainty measures. |
| Outcome: | The proposed method outperforms self-consistency and self-rerank baselines under various task setups by 1.6% and 3.5% respectively. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) require significant computational resources for deployment and use. |
| Approach: | They propose to use low-bit quantization methods to reduce memory footprint and increase inference rate to improve performance of Large Language Models. |
| Outcome: | The proposed methods can reduce the memory footprint and increase the inference rate of LLMs. |
Copied to clipboard
| Challenge: | achieving precise control over generated content and maintaining semantic consistency remain significant limitations, particularly concerning grounding techniques and the necessity for model fine-tuning. |
| Approach: | They propose an off-the-shelf approach that integrates Large Language Models with Bayesian Optimization to facilitate precise and user-friendly image editing. |
| Outcome: | The proposed approach outperforms existing methods in editing accuracy and semantic preservation, as validated using different LLMs including Claude3 and GPT-4. |
Copied to clipboard
| Challenge: | Automatic Speech Recognition systems perform poorly on atypical speech and heavily accented speech. |
| Approach: | They add a residual adapter to the encoder layer to improve model adaptation . they show that the residual adapters update only a tiny fraction of the model parameters . |
| Outcome: | The proposed model fine-tuning improves performance on atypical and accented speech . the system can update only a tiny fraction of the model parameters . |
Copied to clipboard
| Challenge: | Existing methods for large language modeling are based on task-related instructions or prompts. |
| Approach: | They propose a method for generating high-quality sentence embeddings from Large Language Models (LLMs) using meta-task prompts. |
| Outcome: | The proposed method produces high-quality sentences without fine-tuning . it excels on STS benchmarks and in downstream tasks, surpassing models with similar prompts . |
Copied to clipboard
| Challenge: | Existing datasets are limited due to the difficulty of collecting precise molecule-description pairs. Existing approaches to enhance large language models include a data augmentation framework and a new dataset called SAPubChem-41. |
| Approach: | They propose a framework that interweaves model fine-tuning and data augmentation to overcome the scarcity of high-quality labeled data. |
| Outcome: | The proposed framework interweaves model fine-tuning and data augmentation to overcome the scarcity of high-quality labeled data. |
Copied to clipboard
| Challenge: | Recent studies have shown that few-shot text classification is a poor solution for training data-intensive tasks. |
| Approach: | They propose a method that embeds texts and labels into classifiers with proper pre-training. |
| Outcome: | The proposed approach reduces inference cost by increasing the number of labels and embeddings. |
Copied to clipboard
| Challenge: | Existing methods for sparse and dense retrieval have limited success on popular datasets. |
| Approach: | They propose a query expansion approach that generates pseudo-documents by few-shot prompting large language models and then expands the query with generated pseudo-docs. |
| Outcome: | The proposed method boosts the performance of BM25 on ad-hoc IR datasets by 3% to 15% without any model fine-tuning. |
Copied to clipboard
| Challenge: | Recent advances in fine-tuning large language models have greatly enhanced their usage in domain-specific tasks. |
| Approach: | They propose a method which internalizes prompt knowledge during model fine-tuning to achieve efficient inference and save costs. |
| Outcome: | The proposed approach reduces input tokens by 90%, accelerates inference by 4.2 times, and reduces monetary inference costs by 88.3%. |
Copied to clipboard
| Challenge: | Existing methods for fine-tuning Large Language Models rely on heuristic strategies and lack systematic, quantitative frameworks for evaluating data quality. |
| Approach: | They propose a multi-dimensional quantitative framework for reasoning data management . they rigorously evaluate and optimize datasets along six orthogonal dimensions . |
| Outcome: | The proposed framework rigorously evaluates and optimizes datasets along six orthogonal dimensions. |
Copied to clipboard
| Challenge: | Detecting media bias is critical due to the spread of misinformation and disinformation on social media platforms. |
| Approach: | They investigate the presence and nature of bias within large language models and its consequential impact on media bias detection. |
| Outcome: | The proposed debiasing strategies include prompt engineering and model fine-tuning. |
Copied to clipboard
| Challenge: | Out-of-distribution (OOD) detection is critical for reliable predictions over text . fine-tuning with pre-trained language models has been a de facto procedure . |
| Approach: | They propose to leverage pre-trained language models for OOD detection without fine-tuning on ID data. |
| Outcome: | The proposed approach outperforms the fine-tuned model under distributional shifts. |
Copied to clipboard
| Challenge: | Existing efforts to improve medical question answering performance follow two directions. |
| Approach: | They propose a framework that combines a generalist with a domain-specific specialist without any model fine-tuning or parameter updates. |
| Outcome: | The proposed framework boosts GPT-4o accuracy by 13.8%, deepseek-R1 by 16.8%, and improves a vanilla 7B model from 14.1% to 23.9%. |
Copied to clipboard
| Challenge: | Existing concepts-based explainable approaches do not discover unseen concepts . a recent approach to solve this problem is concept-based explanations . |
| Approach: | They propose a framework that extracts comprehensible concepts automatically with no annotations . ECO-Concept uses an object-centric architecture to extract task-specific semantic concepts . |
| Outcome: | a new framework extracts comprehensible concepts with no concept annotations . the proposed framework outperforms existing methods in computability tests on diverse tasks . |
Copied to clipboard
| Challenge: | Existing methods to generate grounded responses are prone to errors due to the irrelevancy of input documents. |
| Approach: | They propose a framework that leverages the insight that a robust grounded response should be consistent with information derived solely from its cited sources. |
| Outcome: | Experiments on three open-domain question-answering datasets show that the proposed framework improves performance by 1.5% to 7% without any model fine-tuning. |
Copied to clipboard
| Challenge: | Recent advances in fine-tuning Vision-Language Models have seen the success of prompt tuning and adapter tuning. |
| Approach: | They propose a method to fine-tune CLIP without introducing any overhead of extra parameters. |
| Outcome: | The proposed method improves CLIP by 7.27% average harmonic mean accuracy. |
Copied to clipboard
| Challenge: | Prompt trading has emerged as a significant intellectual property concern in recent years, where vendors entice users by showcasing sample images before selling prompt templates that can generate similar images. |
| Approach: | They propose a prompt-stealing benchmark consisting of 50 templates and 450 images organized into Easy and Hard difficulty levels. |
| Outcome: | The proposed method outperforms baseline methods with an average improvement of over 10%. |
Copied to clipboard
| Challenge: | specialized fine-tuned models with Arabic and Arabizi scripts achieve the best results . transfer learning demonstrated limited effectiveness, despite ability to adapt to other regionally specific varieties . |
| Approach: | They evaluate the performance of 12 open source LLMs for Arabic and Arabizi scripts . they highlight the impact of Arabic-centric LLM fine-tuning and prompt design on models . |
| Outcome: | The results show that specialized models with Arabic and Arabizi scripts achieve the best results . |
Copied to clipboard
| Challenge: | Nearest Neighbor Machine Translation (kNN-MT) is a powerful domain adaptation tool . the reasons for its success have not been thoroughly investigated . |
| Approach: | They propose to integrate pre-trained Neural Machine Translation models with token-level retrieval . they propose to implicitly execute gradient descent on the output projection layer of NMT . |
| Outcome: | The proposed approach outperforms model fine-tuning on in-domain tests while achieving better performance on out-of-domain sets. |
Copied to clipboard
| Challenge: | Low-resource domains are those where data or annotations are scarce. |
| Approach: | They propose a retrieval-based method for low-resource domains that trains without training . they use web-crawled databases to retrieve relevant textual information from query images . |
| Outcome: | The proposed method outperforms existing training-based methods in low-resource domains . it retrieves relevant textual information from large web-crawled databases . |
Copied to clipboard
| Challenge: | Large language models generate outputs that are not aligned with human values, such as toxic content, malicious use cases, and vulnerabilities to adversarial jailbreak attacks. |
| Approach: | They propose a lightweight inference-guidance technique that can be seamlessly integrated into any autoregressive LLM to semantically filter undesirable content during generation. |
| Outcome: | The proposed technique can be integrated into any autoregressive LLM to semantically filter undesirable content during generation. |
Copied to clipboard
| Challenge: | Existing reranking frameworks optimize semantic relevance, leading to unstable rankings and opaque decisions on long documents. |
| Approach: | They propose a structured reranking framework that reframes financial evidence selection as constraint satisfaction under a finance-aware schema. |
| Outcome: | FINCARDS improves early-rank retrieval over lexical and LLM-based reranking baselines while reducing ranking variance. |
Copied to clipboard
| Challenge: | Existing defense methods are insufficient to address in-context reward hacking (ICRH), where LLMs iteratively optimize their behavior to maximize proxy objectives, resulting in harmful side effects. |
| Approach: | They propose a framework that reduces in-context reward hacking (ICRH) through repeated interactions with the environment. |
| Outcome: | The proposed framework reduces ICRH without model fine-tuning while maintaining task performance. |
Copied to clipboard
| Challenge: | Personalized image aesthetics assessment (PIAA) is an important research problem with practical applications. |
| Approach: | They propose a vision-language model that encodes multi-level aesthetic attributes . they analyze visual representations of VLMs to examine their internal representations . |
| Outcome: | The proposed framework can be used to personalize images without fine-tuning . it can be implemented in a variety of image domains and architectures. |
Copied to clipboard
| Challenge: | State-of-the-art large language models (LLMs) are vulnerable to jailbreak attacks, such as GCG and AutoDAN. |
| Approach: | They propose to take the advances of online In-Context Learning and an offline defensive suffix and optimize them using an iterative algorithm and an online stochastic random search to identify the most effective ICL demonstrations. |
| Outcome: | The proposed method reduces attack success rate to nearly *0% while maintaining the model’s utility on benign tasks and incurring only *negligible* computational overhead. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can learn useful knowledge and harmful stereotypes, making bias evaluation essential. |
| Approach: | They propose a multilingual social bias benchmark that incorporates human-generated reasoning as part of the thinking process. |
| Outcome: | The proposed method demonstrates superior performance over LLM-generated methods . human-generated thinking yields higher-quality evaluations than template-based approaches . |